Responsibilities

Develop big data solutions for batch processing and near real-time streaming

Retrieve, prepare, and process a rich data variety of data sources

Work with business domain experts, data scientists and application developers to identify data that is relevant for analysis

Keep abreast of new developments in the big data ecosystem and learn new technologies

Triage code problems and data-related issues

Qualifications

3+ years of experience with relational database systems, with expertise in SQL

3+ years of programming experience in Java, Python, Scala or similar

3+ years of experience in coding in data management, data warehousing or unstructured data environments

Experience with cloud-based platforms such as AWS, Google Cloud platform or similar

Experience building complex pipelines using automated workflow is a plus, e.g. Luigi, Airflow, Oozie or similar

Experience with parallel data processing is a plus, e.g. MapReduce, Hadoop, Spark or similar

Experience with streaming technologies is a plus, e.g. Kafka, AWS Kinesis or similar

Experience with Business Intelligence tools and platforms is a plus, e.g. Tableau, QlikView, PowerBI, Google Analytics or similar

Experience with Machine Learning is a plus, e.g. TensorFlow, NumPy, Scikit-Learn, Mahout or similar

Good communication in English