Big Data Engineer

Job Description:

The Big Data Engineer will be a key member of the Field Services BI team. You will work closely with Hadoop Administrators, Data Scientists, and business stakeholders.

Job Responsibilities:

• Develop and operate our data pipeline & infrastructure
• Process optimization to produce production ready code
• Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple game franchises.
• Data cleansing and data quality/integrity testing to prepare data for general analytical use
• Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales
• Works directly with business analysts and data scientists to understand, develop data-driven dashboards and solutions to support their use cases
• Owns one or more key components of the infrastructure. Works to identify gaps and improving the platform’s quality, robustness, maintainability, and speed

Job Requirements:

• Experience working with distributed data technologies (e.g. Hadoop, MapReduce, Spark,Kafka) for building efficient, large-scale ‘big data’ pipelines
• Have knowledge of the agile methodology for delivering software solutions
• Excellent ability to articulate and document technical concepts to non-technical audience both verbally and in writing
• Experience building streaming and batch jobs in Spark
• Strong troubleshooting skills (ability to uncover trouble rapidly, investigate root cause and provide resolution)
• Experience with Enterprise class ETL tools (preference IBM DataStage)
• Autonomous, resourceful, strong tolerance to ambiguity, excellent capacity for applied learning
• Bachelor’s degree in Engineering, Computer Science, Operations Research, Science, Mathematics or equivalent experience and / or education
• Strong analytical, communication and time management skills
• DataOps, particularly creating and managing processes for batch and real-time data ingestion and processing

Job Details:

Company: Bell

Job Category: Telecom

Vacancy Type: Full Time

Job Location: Victoria, British Columbia, CA

Application Deadline: N/A

Apply Here

Jobseve.net