Skip to content

Latest commit

ย 

History

History
79 lines (59 loc) ยท 3.59 KB

File metadata and controls

79 lines (59 loc) ยท 3.59 KB

Real-time Trend Commercial Analysis

2022๋…„ 1ํ•™๊ธฐ ์บก์Šคํ†ค๋””์ž์ธ1 ํ”„๋กœ์ ํŠธ

๐Ÿง‘โ€๐Ÿ’ป ๊ตฌ์„ฑ์›

์ด๋ฆ„ ํ•™๊ณผ ํ•™๋ฒˆ ์ด๋ฉ”์ผ Github
์ด์ฐฝ๋ ฌ ์ปดํ“จํ„ฐ๊ณตํ•™๊ณผ 2019110634 lclgood@khu.ac.kr Github Link
ํ—ˆ์ธ๊ฒฝ ์ปดํ“จํ„ฐ๊ณตํ•™๊ณผ 2019102241 red131729@khu.ac.kr Github Link

๐Ÿ”– ์ฃผ์ œ

RTC๋Š” ์˜ˆ๋น„ ์ฐฝ์—…์ž์—๊ฒŒ ํ•„์ˆ˜์ ์ธ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ข…ํ•ฉ์ ์œผ๋กœ ๋ณด์—ฌ์ค„ ์ˆ˜ ์žˆ๋Š” ์†Œํ”„ํŠธ์›จ์–ด๋กœ ์ƒ๊ถŒ ์ •๋ณด, ์ ‘๊ทผ์„ฑ, ์ธ๊ธฐ๋„๋ฅผ ํ† ๋Œ€๋กœ ์‚ฌ์šฉ์ž๊ฐ€ ์„ ํƒํ•œ ์ง€์—ญ์ด ์‚ฌ์šฉ์ž์˜ ์ฐฝ์—… ์ทจ์ง€์— ์ ํ•ฉํ•œ ๊ณณ์ธ์ง€ ์•Œ๋ ค์ค€๋‹ค.

๐Ÿ“‘ ํ”„๋กœ์ ํŠธ ์†Œ๊ฐœ

๋ถ„์‚ฐ๋˜์–ด ์žˆ๋Š” ๋Œ€์šฉ๋Ÿ‰ ๋น„์ •ํ˜• ๋ฐ์ดํ„ฐ๋ฅผ Kafka๋ฅผ ์ด์šฉํ•˜์—ฌ S3์— ์ €์žฅํ•œ ํ›„, Spark๋ฅผ ํ†ตํ•ด ๋น…๋ฐ์ดํ„ฐ ์—ฐ์‚ฐ์„ ์ง„ํ–‰ํ•˜๋Š” ๋ฐ์ดํ„ฐ ๋ ˆ์ดํฌ๋ฅผ ๊ตฌ์ถ•ํ•œ๋‹ค. ์—ฐ์‚ฐ์ด ์™„๋ฃŒ๋œ ๋ฐ์ดํ„ฐ์— ์‰ฝ๊ฒŒ ์ ‘๊ทผํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉ์ž๋Š” Django๋ฅผ ๋ฐ์ดํ„ฐ๋ฅผ ์š”์ฒญํ•˜๊ณ  ์‹œ๊ฐํ™”๋œ ๊ฒฐ๊ณผ๋ฌผ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋‹ค.

๐Ÿ“‹ Project Introduction

As a service for prospective entrepreneurs, it is a service that informs which business is suitable for a certain location before starting a business. It collects and refines a large amount of information required from various open API sites, and the information comes out when the user selects a location.

๐Ÿ”Ž ํ”„๋กœ์ ํŠธ ๊ตฌ์กฐ๋„

ํ”„๋กœ์ ํŠธ ๊ตฌ์กฐ๋„๋ฅผ ๊ฐ„๋‹จํ•˜๊ฒŒ ๋ฌ˜์‚ฌํ•˜๋ฉด ๋‹ค์Œ ์‚ฌ์ง„๊ณผ ๊ฐ™๋‹ค.

๐Ÿ—ƒ๏ธ Development Environment

  • Apache Kafka on AWS EC2
  • Apache Spark on AWS EMR
  • Django
  • AWS S3

๐Ÿ–ผ๏ธ ์‹œ์—ฐ ํ™”๋ฉด

โ›“๏ธ ํ”„๋กœ์ ํŠธ ํ๋ฆ„

  1. ์Šค์ผ€์ฅด๋Ÿฌ๊ฐ€ Kafka๋ฅผ ์‹คํ–‰์‹œ์ผœ ์ฃผ๊ธฐ์ ์œผ๋กœ ๋ฐ์ดํ„ฐ๋ฅผ ์ˆ˜์ง‘ํ•œ๋‹ค. ์ด ๋ฐ์ดํ„ฐ๋“ค์€ ๋ฐ์ดํ„ฐ๊ฐ€ ์‚ฌ์šฉ ์ค€๋น„ ์ƒํƒœ๊ฐ€ ๋  ๋•Œ๊นŒ์ง€ ์›์‹œ ์ƒํƒœ๋กœ ๋ณด๊ด€๋œ๋‹ค.
  2. Spark๋Š” ๋ฐ์ดํ„ฐ์— ์ ‘๊ทผํ•˜์—ฌ ์—ฐ์‚ฐ์— ํ•„์š”ํ•œ ๋ฐ์ดํ„ฐ๋ฅผ ์ •์ œํ•œ ํ›„, ๋ถ„์„ ๋ ˆํฌํŠธ๋ฅผ ์ƒ์„ฑํ•œ๋‹ค.
  3. ๋ถ„์„ ๋ ˆํฌํŠธ๋Š” ๋งค์ผ ๊ฐฑ์‹ ๋œ๋‹ค.
  4. ์‚ฌ์šฉ์ž๋Š” Django์„ ํ†ตํ•ด ์–ป๊ณ  ์‹ถ์€ ์ •๋ณด๋ฅผ ํš๋“ํ•œ๋‹ค.

๐Ÿ—บ๏ธ ๊ฒฐ๊ณผ

์ฒซ ํ™”๋ฉด์—๋Š” ์‹œ์ž‘ํ•  ์ˆ˜ ์žˆ๋Š” ๋ฒ„ํŠผ๊ณผ ๋ฐ์ดํ„ฐ๋ฅผ ์ตœ์‹ ํ™”ํ•  ์ˆ˜ ์žˆ๋Š” ๋ฒ„ํŠผ์ด ์žˆ๋‹ค. ๋ฐ์ดํ„ฐ ์ตœ์‹ ํ™”ํ•˜๊ธฐ ๋ฒ„ํŠผ์„ ํด๋ฆญํ•˜๋ฉด API๋ฅผ ํ˜ธ์ถœํ•˜์—ฌ ์ƒˆ๋กœ์šด ๋ฐ์ดํ„ฐ๋ฅผ ๊ฐ€์ ธ์˜ค๋Š” ๊ณผ์ •์„ ์‹œ์ž‘ํ•œ๋‹ค.

ํ™•์ธํ•˜๊ณ  ์‹ถ์€ ํ–‰์ •๊ตฌ์—ญ์„ ์„ ํƒํ•œ ํ›„, ํ–‰์ •๊ตฌ์—ญ ์•ˆ์— ์žˆ๋Š” ํ–‰์ •๋™๊ณผ ๋…„๋„, ๋ถ„๊ธฐ๋ฅผ ์ฐจ๋ก€๋Œ€๋กœ ์ž…๋ ฅํ•œ๋‹ค.

๊ฒฐ๊ณผ ํ™”๋ฉด์—์„œ๋Š” ์ตœ์ข… ์ฐฝ์—… ์ถ”์ฒœ ์ˆœ์œ„์™€ ํ•จ๊ป˜ ์ง€์ • ์ƒ๊ถŒ ์—ฌ๋ถ€๋ฅผ ์•Œ๋ ค์ฃผ๊ณ  ์ฐฝ์—…์— ๊ด€๋ จ๋œ ์ฃผ์ œ๋ฅผ ๊ธฐ๋ณธ์œผ๋กœ ์–ด๋– ํ•œ ์ˆœ์œ„๋ฅผ ๋ฐ›์•˜๋Š”์ง€ ๋ณด์—ฌ์ค€๋‹ค.

๋™์‹œ์— ๊ทผ์ฒ˜ ํ–‰์ •๊ตฌ์—ญ๋“ค์˜ ์ •๋ณด๋ฅผ ๋ณด์—ฌ์ค€๋‹ค.

๋งˆ์ง€๋ง‰์œผ๋กœ ์„ ํƒํ•œ ํ–‰์ •๋™์— ์กด์žฌํ•˜๋Š” ์ƒ๊ถŒ ๋งค๋ฌผ๋“ค์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ๋ณด์—ฌ์ค€๋‹ค.

์ƒ๊ถŒ ๋งค๋ฌผ ์ •๋ณด๋กœ๋Š” ๋‹ค์Œ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋‹ค.

  • ๋งค๋ฌผ ์‚ฌ์ง„
  • ๋งค๋ฌผ ํฌ๊ธฐ
  • ์ƒ์„ธ ์œ„์น˜
  • ๊ด€๋ฆฌ๋น„ ๋ฐ ๊ฐ€๊ฒฉ
  • ๋งค๋ฌผ ๊ณผ๊ฑฐ ๊ธฐ๋ก์— ๋”ฐ๋ฅธ ์ถ”์ฒœ ๊ฑด๋ฌผ ์šฉ๋„
  • ์ •๋ณด ์—…๋ฐ์ดํŠธ ์‹œ๊ธฐ