Big Data Engineer

IBM is seeking to hire a Big Data Engineer to help with our current demands in big data technologies. We are looking for strong, experienced candidates with 3-4 years of big data ecosystem experience who have done similar work elsewhere (Financial Services experience is a plus)
Lead definition and socialization of end to end big data enablement solution architecture Design, develop, and implement a real time data, integration, and cognitive fabric using Big Data technologies such as Hadoop, Spark, HBase Be accountable for the solution design and development of Hadoop/Spark environments integration with analytic platforms, Enterprise Information Management (EIM), and Data Warehouse (DW) platforms Formulate approaches and gather data to solve business problems, develop conclusions and present solutions through formal deliverables A successful history of manipulating, processing and extracting value from large disconnected datasets
Required Technical and Professional Expertise:
Strong experience in Hadoop platform and data architecture Strong experience in use of open source tools such as: Hadoop, Hive, HBase, Spark, Storm, Kafka and file storage formats (Parquet, Avro, ORC) Candidate must have prior experience working with one or more of the following: Cloudera Hadoop Distribution, Hortonworks Data Platform, MapR, Microsoft HDInsights Fluency in several programming languages such as Java, Scala or Python with the ability to pick up new languages and technologies quickly Experience working on Hadoop cluster setting, Map Reduce, Job Optimizations, Queue management, Job Scheduling/Orchestration using Oozie Working experience on development, build & deployment tools such as Eclipse, Maven, Git, Jenkin, Gradle Experience working with Tableau and Big Data Lake integration is a plus

Don't Be Fooled

The fraudster will send a check to the victim who has accepted a job. The check can be for multiple reasons such as signing bonus, supplies, etc. The victim will be instructed to deposit the check and use the money for any of these reasons and then instructed to send the remaining funds to the fraudster. The check will bounce and the victim is left responsible.

More Jobs

Director, Engineer Global Data Centers & Facil...
Long Island City, NY The Estee Lauder Companies
Data Visualization Editor
New York City, NY Dow Jones
Audio Engineer
New York City, NY Dow Jones
Field Engineer Apprentice
New York City, NY General Electric
Field Service Engineer
New York City, NY Thermo Fisher Scientific