wynalazkowo - eksperymenty małe i duże

Apache Airflow

Apache Airflow

Recently I had the opportunity to play with this kind of scheduler for data pipelines tasks. It is mega simple to setup either on bare-metal or as docker worker or in Kubernetes using Helmchart acc. to this desciption: https://airflow.apache.org/docs/apache-airflow/stable/installation/index.html This software enables to create data pipelines for extracting data, decorating and saving in different place.Więcej oApache Airflow[…]

Graph database

Graph database

A graph database is defined as a specialized, single-purpose platform for creating and manipulating graphs. Graphs contain nodes, edges, and properties, all of which are used to represent and store data in a way that relational databases are not equipped to do. Graph analytics is another commonly used term, and it refers specifically to the process ofWięcej oGraph database[…]

TIBCO

TIBCO

As one of my task is also learning TIBCO EMS – here are my notes. You can expect more one this topic;) TIBCO Messaging provides components to support messaging / communications. From high-performance (millions of messages a second) to low latency (sub-microsecond delivery) to fully transactional enterprise-class distribution, streaming data and open source support.Components ofWięcej oTIBCO[…]

Zookeeper

Zookeeper

I have heard about this software many times in relation to BigData, Hadoop, Kafka, but never went into detailed knowledge about this until today. So here is short description of this technology and usage of it: ” Zookeeper was invented by Apache as opensource project: https://github.com/apache/zookeeper. ZooKeeper is a centralized service for maintaining configuration information,Więcej oZookeeper[…]

Omnitracker – integration with ServiceNow – last words

Omnitracker – integration with ServiceNow – last words

This is continuation of story, which started last year in March. For following months we were fighting, fixing and adjusting this interface. Here are some more issues which should have been considered at the beginning of this project, but everybody knows that the wisest you are after the facts;): there should be a mapping betweenWięcej oOmnitracker – integration with ServiceNow – last words[…]

Pi hole – blokowanie reklam w Twoim domu.

Pi hole – blokowanie reklam w Twoim domu.

A to kolejny wpis mojego męża: Zacznijmy od tego – czym jest pi hole? Pi hole to prywatny DNS z opcją filtrowania adresów kojarzonych z reklamami. Po co to komu w czasach AdBlocka? Otóż adblock nie jest niestety doskonały – po pierwsze jest wykrywany przez różne strony, które potem serwują nam żebrozasłonę z tekstem “przecieżWięcej oPi hole – blokowanie reklam w Twoim domu.[…]

Omnitracker -extraction of attachments

Omnitracker -extraction of attachments

Here is magic query to extract all attachments from Omnitracker and their physical storage. select request, 'path_to_your_attachments\’+substring(filename_on_disk,1,2)+’\’+ substring(filename_on_disk,3,2)+’\’+ substring(filename_on_disk,5,2)+’\’+filename_on_disk+’.’+ substring(orig_name,len(orig_name)-2,3) as fileOnDisk, orig_name from ( SELECT [id], CONVERT(varchar(MAX),CONVERT(VARBINARY(8),id),2) as filename_on_disk ,[request] ,[orig_name] FROM [Attachment] where request in (617674,760232,…))a requests_id can be retrieved from this query: select request from UserFields1 where f19_titel=”your title of Incident/RFC/Problem”