Technology Archive | Baiyuan's Blog

AWS Fargate Quick Facts

1 months ago (11-05) Views: 5 Comments: 0

The AWS fargate re:invent Conference, released in November 2017, is a technology that lets you run containers without having to manage servers or clusters, and we only care about the application image and the resources it needs. [Caption Id= "" align= "AlignCenter" width= "743"] Location of AWS Fargate on the technology radar [/caption] AWS fargate: Keywords DevOps, cloud computing domain A cloud service for AWS Severless: No Server Container running Platform and EC2 instance at a level Support for ECS, Eks:amazon Ecs/eks has two modes: Fargate Startup Type and EC2 Startup type Properties due to ECS Monitoring Elastic Scaling Health Check Blue-Green Deployment Load Balancing Ecr:aws Mirror Warehouse Scheduled Tasks Network configuration Cloudformation: Infrastructure is code From the container running platform aspect: Fargate compared to EC2 Instance difference, Advantage [Caption Id= "" align= "AlignCenter" width= "644"] EC2 vs Fargate: architecture [/caption] EC2 Instance vs Fargate: Security Transfer security responsibilities to cloud service vendors Ami: System Update Security vulnerabilities Ssh SSH Key Fortress machine EC2 Instance vs Fargate: Pricing method Fargate Total cost (in resources) = Total cost of Vcpus + total memory cost Total Vcpus cost = number of Vcpus x per cpu-second price x CPU duration (seconds) Total memory

Elasticsearch incremental data synchronization and seamless upgrade

2 months ago (10-07) Views: 5 Comments: 0

Elasticsearch as an open-source full-text search engine in today's software development has been more and more widely used in business function development, you can choose Elasticsearch to provide more powerful than database query search method, Also based on search results scoring (weights) and highlighting makes it easy for us to implement a search engine within a station. ElasticSearch VS Database When we first approached Elasticsearch (ES), we often used it in analogy with the database to learn from the structure: Indices similar to database Type a table similar to database fields are similar to columns in a data table Documents are similar to the rows of a data table (that is, each record) at the same time, the database provides the search syntax to find shadows on ES, such as the database provides and, or logical operators, ES has must, should, and the database such as "like" The text matching feature is more powerful in ES. Still, ES is essentially a search engine.NoSQL and ES all have the same loosely structured structure, although we also have some discussion about whether ES can be used to replace non-relational databases (regardless of if ES is a nosql), but one reality is that

Container as a service: AWS fargate

4 months ago (08-23) Views: 5 Comments: 0

This article is translated from: Freecodecamp, original address: An intro to Amazon fargate:what It was, why it's awesome (and not), and when to use it, English original author for Em Manuel Marboeuf When Amazon announced Fargate with Eks at the end of 2017 at the AWS Re:invent Conference, it was left out of the doghouse, when the blogs and the big guys I was focusing on were just mildly saying: Oh, there's a new gadget that will allow ECS users to run containers directly in the cloud. As a developer, it really surprised me.Let's see why. Liberating productivity I think there have been five major revolutions in the field of software development, greatly improving the productivity of developers and writing and deploying applications at the highest efficiency.They all solved a series of major problems: The advent of cloud services (IaaS): Addressing the cost and scalability issues of infrastructure Open source community, conferences, workshops, technical blogs, stackoverflow, etc.: let knowledge reach more people Version control systems, collaboration tools, and continuous integration tools solve concurrent project development and integration issues containerized architecture Server and system management costs are reduced by server-less computing services (PaaS) All of these revolutions have a common feature:

Continuous building of container images using Dockerhub

4 months ago (08-22) Views: 4 Comments: 0

Context As a lightweight virtualization container technology, Docker is widely used in today's automated operations, along with the major cloud platforms AWS, Aliyun, and the container orchestration engine kubernetes are also based on Docker as a basic unit of service. So the first step in deploying an application is to create an application image, that is, to write dockerfile, such as The basic process is: Based on a base image, such as Java:alpine Build a project to generate a product, such as a JRE The portal that defines the image is entrypoint or cmd, "Java-jar xx.jre" In the actual project, the Dockerfile is far from simple, for example, the underlying image provided by OPENJDK may not have the environmental dependencies we need, such as the need for gradle support when building a Java project, such as a dependency package that is posted on GitHub, We need a git command, or we need to use Gitcrypt to decrypt some sensitive environment variables when we run the mirror, which means that we need to make some modifications based on the underlying image, such as: Run apkes on more and more, We'll find that the ever-bloated Docker image can seriously slow down

Introduction to micro-letter Applet

4 months ago (08-16) Views: 11 Comments: 0

Recently in the micro-letter program, the guests summed up some introductory experience, hoping to help students who want to learn the small program to provide reference One, micro-letter Small program file structure: ▸pages/: A paging file, a small program consists of a page (analogous to the activity or the pages component inside the Reactjs) ▸utils/: Put some tool methods . App.js: Small program startup, analogous to Android application class or Mainactivity App.json: The global configuration file of the applet, which is analogous to the Android manifest file, declares which page the applet has. APP.WXSS: A global CSS style file Project.config.json: project configuration file, definition of project name, Base library version, AppID, etc. Small program consists of a page, analogous to the activity of Android, and other components of the same life cycle, in addition, small program development and Reactjs very much like, such as react inside the use of state management interface data, small program has a almost identical to this, Called Data. Onlaunch Function Life cycle function – Listener applet initialization When the applet initialization is complete, onlaunch is triggered (the global trigger only once). OnShow Function Life cycle Functions – Monitor applet display OnShow is triggered when the

Monitoring and visualization tools for "translating" microservices architectures

7 months ago (05-04) Views: 3 Comments: 0

I've been thinking lately if there's something that shows the invocation relationships between our multiple microservices, and shows their state, and shows the flow of data through the network topology diagram, error tracing, it's a good framework if you do it all in a generic way.The main idea is to set up a certain communication protocol for each micro-service, so that they comply with a certain protocol on the reporting server, the server for UI display.As the saying goes, "foreign companies will play", only to find that some companies have been made. This article translated from: Tools to Monitor and visualize microservices Architecture | Programmableweb After you build and deploy a distributed application, it is critical to monitor and visualize it to ensure software reliability, availability, and expected performance.It's not easy. The heterogeneous and distributed nature of applications driven by microservices architectures makes monitoring, visualization, and analysis a challenge.Traditional application monitoring and performance management (APM) solutions are not suitable for today's complex distributed applications. Fortunately, several new APM solutions have been introduced in the past few years to address these issues.These APM solutions use advanced technologies such as artificial intelligence (AI), machine learning, and graphical analysis to monitor, visualize, and

Docker in Docker

8 months ago (04-24) Views: 17 Comments: 0

Docker run Docker? Docker technology is currently widely used in DevOps. We need to package the test or build code and automation scripts into Docker images and deploy them in various operating environments.In CI/CD, we use some CI/CD servers, such as Jenkins and GoCD, to build and deploy our applications to automate CI/CD.Now some CI/CD servers are also Dockerized on real physical machines.So we need to build (build) and run our Docker image inside the Docker container of the CI/CD server. This involves the "Docker run Docker" problem. A very natural idea is, do we need to install a Docker Daemon and Docker command in the CI/CD server image?However, running Docker in Docker always feels awkward. Extra installation and running of Docker undoubtedly increases the size of the CI/CD server image, and also increases the depth of Docker. In fact, we do not need to install Docker on the CI/CD server.Run our image on the CI/CD server with the following command: Principle: Grafting Docker adopts the C/S architecture. Docker's successful operation requires the support of Docker Daemon and Docker Client (client). When we run some commands such as docker build, we actually need Docker Client to connect to Docker Daemon

[5] Real-time image transmission of binocular camera – Smart car under Pcduino platform

9 months ago (03-27) Views: 64 Comments: 0

One, Mjpg-streamer open source library Due to the development of a real-time video push system, it may involve the implementation of a streaming media server, but it can be realized quickly and easily through the "MJPG-streamer" open source tool."MJPG-streamer" is a mature, lightweight video server software that can be used to capture camera images and publish them on real-time video servers.MJPG-streamer adopts the modularized design idea, including input module and output module. The input module defines the input source, such as camera, file, etc. MJPG-streamer then outputs the video through the output module, such as http output and other network output. Local output of the file [8]. This article uses a binocular camera supporting UVC protocol as the input source of image data. The http protocol is used to push the video stream. Therefore, the components involved are the output_http output component and the input_uvc input component.With MJPG-streamer, it is easy to push the binocular camera video on the pcDuino to the http protocol. Second, to achieve and test The use of MJPG-streamer library to develop a real-time image transmission system is convenient and efficient. Its installation command is as follows: After the installation is complete, you can use the

[4] Communication instruction design – smart car under Pcduino platform

9 months ago (03-27) Views: 19 Comments: 0

First, the command packet protocol design In the remote control smart car system, the remote client controls the smart car through command communication.In the design of this paper, only the speed direction control instruction is involved. In order to consider the scalability of the system: because there may be more types of instructions for subsequent requirements, this article has designed the instruction code for the instruction data. The instruction consists of the instruction code and the instruction data area; consider To the client and the server to better handle the instruction, the instruction word length is 32 bits, and the int data type word length is equal to the int data processing when the server and the client socket socket to send and receive data .In studies similar to this design, char characters are often used to control the direction. I think it is inadequate. Because a char type can quantify and access data, it can save network traffic and ensure real-time performance. Instruction code (4bit) Command data area (28bit) When the command code is 1, the speed direction control command of the sending vehicle is indicated, and the command data package is a schematic diagram: 0

[3] System architecture and assembly – Smart car under Pcduino platform

9 months ago (03-27) Views: 23 Comments: 0

First, system design In this paper, the smart car communication control system is mainly composed of a Freescale car model, a pcDuino development board and its external module, a remote control client (smartphone), and a wireless LAN device. The schematic diagram of the system structure is as follows: In order to use the pcDuino to control the motors and servos of the smart car model, this article uses the L298P expansion module to plug into the Arduino compatible hardware interface on the pcDuino motherboard. Due to the mismatch of the L298P and pcDuino motherboard levels, the middle part is completed through the T board module. Level shifting.The binocular camera accesses the pcDuino through the USB interface. Since the pcDuino is equipped with a wireless WIFI module, it can complete the networking through the wireless LAN and external remote clients to achieve remote communication and control. In order to use the smart phone client to control the smart car system, this design uses a smart phone connected to the local area network to send commands to the smart car system. The system structure is a typical C/S (client-server) structure, which means The smart car pcDuino development board serves as the server,