Senior Data Engineer

United States
Full Time
Experienced

EMPLOYER: Smartbridge, LLC

ADDRESS: 2050 West Sam Houston Parkway South, Suite 1425 Houston, Texas 77042

CONTACT: Ms. Deepthi Raju

BUSINESS: Technology Consulting

JOB TITLE: Senior Data Engineer

Job Duties: Smartbridge LLC in Houston, Texas seeks a Senior Data Engineer to implement Azure Resource Groups, Resource Tags, AAD groups, and Role based access. Design and deploy applications utilizing AZURE stack (Including Azure VM’s, Blob Storage, SQL Database, Data Factory, Virtual Network, Traffic Manager, Load Balancer, AKS, Key Vault, Log Analytics) to achieve high-availability fault tolerance, and auto scaling in Azure Resource Manager. Demonstrate experience in designing and implementing scalable, reliable, and fault-tolerant systems and infrastructure. Proficiency in developing automation tools and scripts using languages such as Python and Bash to streamline deployment, monitoring, and maintenance processes. Develop Terraform scripts, Azure CLI, and ARM templates to automate the provisioning and deployment process.

Create CI/CD Pipelines in Azure DevOps environments by providing their dependencies and tasks. Work with automation tools which are pre-installed in azure DevOps portal to build the packages. The automation tools like ANT and MAVEN with build.xml and pom.xml scripting languages depending on the packages like java, python, or .NET. Strong understanding of distributed computing concepts and experience working with Data bricks clusters to scale data processing and machine learning workflows. Serve as a technical advisor to customers, provide guidance on best practices, architecture design, and implementation strategies related to Azure services that might involve conducting workshops, assessments, and technical deep dives to help customers optimize their Azure deployments.

Implement and maintain monitoring and alerting systems using tools such as Prometheus, Grafana, and PagerDuty, resulting in a reduction in downtime through proactive issue detection and resolution. Use Jenkins to deploy code to Azure create a new namespace, creating Docker images and pushing them to the container registry. Involve in setting up a Microservice architecture for application development. Create Clusters using Kubernetes and work on creating many pods, replication controllers, services, deployments, labels, health checks and ingress by writing YAML files. Implement a production ready, load balanced, highly available, fault-tolerant, auto scaling Kubernetes infrastructure and micro service container orchestration. Send resumes to: [email protected] REF: SMB 1944

MINIMUM

REQUIREMENTS:

EDUCATION: Master’s Degree in Computer Science, Information Systems, Electrical Engineering, or Engineering Management.

EXPERIENCE: 60 months of experience in the job offered

Share

Apply for this position

Required*
Apply with
We've received your resume. Click here to update it.
Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Human Check*