Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Roboto #10

Closed
wants to merge 89 commits into from
Closed
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
89 commits
Select commit Hold shift + click to select a range
e52b9d2
added spi and raspicam... not done yet
smigad Sep 16, 2017
a8ca4bb
fix spi
smigad Sep 18, 2017
5d6e99d
clean up
smigad Sep 18, 2017
b6aadff
minor mod
smigad Sep 18, 2017
0afb984
add gpio sig in spi
smigad Sep 20, 2017
2ee5d55
gpio int for spi
smigad Sep 20, 2017
172b464
add face landmark
smigad Nov 7, 2017
b109914
Merge branch 'master' of https://github.com/Dagiopia/OpenCogER
smigad Nov 7, 2017
36c75de
bla bla
smigad Nov 7, 2017
ad6f2c2
flm detect done
smigad Nov 8, 2017
447b5f8
lil mod
smigad Nov 8, 2017
3bd385d
eyes closed/open detect
smigad Nov 9, 2017
3e7b247
nod
smigad Feb 21, 2018
a9a0639
some
smigad Feb 21, 2018
781a3e6
head
smigad Feb 21, 2018
32383ef
mod
smigad Mar 2, 2018
5840e02
lil mod
smigad Mar 2, 2018
1d5b6ae
refac
smigad Mar 7, 2018
8117c28
rm old
smigad Mar 8, 2018
49e65ab
begin facial expression
smigad Mar 17, 2018
eb774ea
hand det & finger count
smigad Mar 27, 2018
9ab344f
hand haar model
smigad Mar 27, 2018
3331879
mods
smigad Mar 27, 2018
850b056
lil mod
smigad Apr 2, 2018
e61fb0a
saliency wrapper
smigad Apr 2, 2018
77d164a
lil mod
smigad Apr 3, 2018
a61fdb1
some debug info
smigad Apr 3, 2018
f81bbb6
fix on pi
smigad Apr 4, 2018
393aa00
raspi
smigad Apr 19, 2018
4450e0d
raspi src
smigad Apr 19, 2018
4d02890
func times
smigad Apr 19, 2018
271d61b
test
smigad Apr 19, 2018
443e49c
Merge pull request #1 from Dagiopia/master
smigad Apr 19, 2018
add5e8c
mod
smigad Apr 23, 2018
701027e
merg
smigad Apr 23, 2018
d2e3076
all
smigad Apr 23, 2018
9064b39
dbg info
smigad Apr 23, 2018
c75eec1
Merge pull request #2 from Dagiopia/master
smigad Apr 23, 2018
755dba2
update readme
smigad Apr 24, 2018
61ecf3f
readme
smigad Apr 24, 2018
d7c5913
Merge pull request #4 from Dagiopia/master
smigad Apr 24, 2018
decc66a
new model
smigad Apr 24, 2018
d26112f
Merge branch 'master' of https://github.com/opencog/OpenCogER
smigad Apr 24, 2018
4fb39d2
landmark model numbers were wrong
smigad Apr 25, 2018
f2c94d1
begin rpc
smigad May 1, 2018
d287909
lil
smigad May 1, 2018
16d5984
git ignore
smigad May 1, 2018
531d26b
sal on rpc
smigad May 2, 2018
079d649
some mod
smigad May 3, 2018
aac7b6e
mod
smigad May 4, 2018
62336c8
includes
smigad May 4, 2018
04b8940
rpc work
smigad May 4, 2018
e18c96f
rpc example... nothing is tested
smigad May 5, 2018
2d1bab4
rpc
smigad May 7, 2018
b0afebe
rm unwanted
smigad May 7, 2018
83430d5
fix
smigad May 7, 2018
d24dda7
Merge pull request #5 from Dagiopia/master
smigad May 7, 2018
00efce4
Merge branch 'master' of https://github.com/opencog/OpenCogER
smigad May 16, 2018
cc75a54
scm wrapper
smigad May 16, 2018
f313304
fix
smigad May 16, 2018
c14be2c
scm script
smigad May 16, 2018
daf2c8d
fix
smigad May 16, 2018
2bb5077
add ghost integration from https://github.com/Eskender-B/dr-roboto.git
smigad May 20, 2018
58c615f
update readme
smigad May 20, 2018
1de0e34
Merge pull request #6 from Dagiopia/master
smigad May 20, 2018
354a36a
General README cleanup
linas May 20, 2018
c19da85
some wrapping
smigad May 24, 2018
946d6e4
the 26 facial landmark to be used
Geta-meko May 25, 2018
622b623
26 markup flms
Geta-meko May 25, 2018
c1f2cbd
Merge pull request #7 from Geta-meko/master
smigad May 25, 2018
f37f8e0
some mods
smigad May 25, 2018
128d6fa
begin stt
smigad May 28, 2018
df42d0e
Merge branch 'master' of https://github.com/opencog/TinyCog
smigad May 28, 2018
df16ea7
stt
smigad May 28, 2018
a96b793
work on stt and some mods on dr roboto
smigad May 29, 2018
c179feb
fix error
smigad May 29, 2018
121751f
Merge pull request #8 from Dagiopia/master
smigad May 29, 2018
dfc22ac
Fix cmake var ON_RPI_3
Eskender-B May 29, 2018
452d95a
Organize code structure
Eskender-B May 29, 2018
0abe968
minor and readme
smigad May 29, 2018
f198214
facial expression
Geta-meko Jun 1, 2018
a823361
Fix cmake file and stt
Eskender-B Jun 5, 2018
4385b86
Make basic demo; Need to fix
Eskender-B Jun 6, 2018
03a015e
Merge branch 'master' into mine
Geta-meko Jun 7, 2018
be8c43f
Merge pull request #9 from Geta-meko/mine
smigad Jun 7, 2018
728bc97
Make a working demo; still need fixing
Eskender-B Jun 11, 2018
10c5a30
Merge branch 'master' of https://github.com/opencog/TinyCog
Eskender-B Jun 11, 2018
9cb6429
Demo face smile detection and chat
Eskender-B Jun 18, 2018
f0ed444
smile added
Geta-meko Jun 28, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
added spi and raspicam... not done yet
  • Loading branch information
smigad committed Sep 16, 2017
commit e52b9d2681bb8d27d02941246fdc5aed5bafd199
17 changes: 15 additions & 2 deletions CMakeLists.txt
Original file line number Diff line number Diff line change
@@ -1,14 +1,16 @@
cmake_minimum_required(VERSION 3.1)
project( OpenCogER )
set (CMAKE_CXX_STANDARD 11)
set(CMAKE_MODULE_PATH ${CMAKE_MODULE_PATH} "${CMAKE_SOURCE_DIR}/cmake/")
set(CMAKE_MODULE_PATH ${CMAKE_MODULE_PATH} "${CMAKE_SOURCE_DIR}/cmake/" "/usr/local/lib/cmake/")
if(CMAKE_COMPILER_IS_GNUCXX)
set(EXTRA_LIBS ${EXTRA_LIBS} pthread)
endif()
############Vision
find_package( OpenCV REQUIRED )
find_package(raspicam REQUIRED)
include_directories("include" "include/sensor/vision")
add_library( sensor_vision sense/vision/capture/CamCapture.cpp
sense/vision/capture/RaspiCamCapture.cpp
sense/vision/capture/FileCapture.cpp
sense/vision/capture/ITColor2Gray.cpp
sense/vision/capture/ITEqualizeHist.cpp
Expand All @@ -24,6 +26,9 @@ target_link_libraries(VisionTest sensor_vision ${OpenCV_LIBS} ${EXTRA_LIBS})
add_executable(VisionTestFace examples/sense/vision/VisionTestFace.cpp)
target_link_libraries(VisionTestFace sensor_vision ${OpenCV_LIBS} ${EXTRA_LIBS})

add_executable(RaspiVisionTest examples/sense/vision/RaspiVisionTest.cpp)
target_link_libraries(RaspiVisionTest sensor_vision ${raspicam_CV_LIBS} ${EXTRA_LIBS})

configure_file(data/Haar_Cascades/haarcascade_frontalface_alt.xml haarcascade_frontalface_alt.xml COPYONLY)
configure_file(data/Haar_Cascades/haarcascade_smile.xml haarcascade_smile.xml COPYONLY)

Expand Down Expand Up @@ -57,4 +62,12 @@ add_executable( exUDPserver examples/network/exUDPserver.cpp)
target_link_libraries(exUDPserver networkr)

install (TARGETS networkr DESTINATION lib/OpenCogER)
install (FILES StringServerUDP.hpp DESTINATION "include/OpenCogER/network")
install (FILES StringServerUDP.hpp DESTINATION "include/OpenCogER/network")

#######COMM
include_directories("include/comm/spi")
add_library(spicomm comm/spi/SpiComm.cpp)
target_link_libraries(spicomm)

add_executable(SPICommTest examples/comm/spi/SPICommTest.cpp)
target_link_libraries(SPICommTest spicomm)
108 changes: 108 additions & 0 deletions comm/spi/SpiComm.cpp
Original file line number Diff line number Diff line change
@@ -0,0 +1,108 @@
/*
Project: OpenCogER
File: SpiComm.cpp
Author: Dagim Sisay
Licence: AGPL
Date: September 2017
*/

#include "SpiComm.hpp"


SpiComm::SpiComm(std::string device, spi_mode sm, uint16_t freq)
{
okay = false;
mode = 0;
dev = device;
speed = freq;
bpw = 8;
switch (sm) {
case MODE0: break;
case MODE1:
mode |= SPI_CPHA;
break;
case MODE2:
mode |= SPI_CPOL;
break;
case MODE3:
mode |= SPI_CPHA;
mode |= SPI_CPOL;
break;
}

fd = open(device.c_str(), O_RDWR);
if(fd < 0)
exit_p("Couldn't Open Device");
if( ioctl(fd, SPI_IOC_WR_MODE, &mode) == -1)
exit_p("Couldn't Set Spi Mode");
if( ioctl(fd, SPI_IOC_WR_BITS_PER_WORD, &bpw) == -1)
exit_p("Couldn't Set Bits Per Word");
if( ioctl(fd, SPI_IOC_WR_MAX_SPEED_HZ, &freq) == -1)
exit_p("Couldn't Set SPI Clock Speed");

okay = true;

}

SpiComm::~SpiComm()
{
close(fd);
}


std::string SpiComm::send_data(std::string data)
{
size_t len = data.size();
uint8_t *packet;
size_t packet_len = len + 8;
uint8_t header[8] = {0xAA, 0x55, 0x0, 0x0, 0x01, 0x0, 0x0, 0x0};
header[PACKET_SIZE_L_IDX] = len & 0xff;
header[PACKET_SIZE_H_IDX] = len >> 8;
packet = new uint8_t[len+8];

/* Attach Header */
for (int i = 0; i < 8; i++)
packet[i] = header[i];
/* Attach Data */
for(int i = 8; i < packet_len; i++)
packet[i] = (uint8_t)data.at(i-8);

if(DEBUG)
printf("Size of Packet: %d\nPacket Content: %s\n", packet_len+8, packet);

uint8_t rx[len] = {0,};
spi_ioc_transfer tr;
tr.tx_buf = (unsigned long)packet;
tr.rx_buf = (unsigned long)rx;
tr.len = packet_len;
tr.delay_usecs = 0;
tr.speed_hz = speed;
tr.bits_per_word = bpw;

int ret = ioctl(fd, SPI_IOC_MESSAGE(1), &tr);
printf("Ret=%d\n");
//if(ret < 1)
// exit_p("Couldn't Send The Message");
std::string ret_data;
for (int i = 0; i < packet_len; i++){
ret_data.append<int>(1, rx[i]);
printf("%x ", rx[i]);
}
printf("\nFinal Data Size = %d\n%s\n", ret_data.size(), ret_data.c_str());
return ret_data;
}

void SpiComm::sigint_handler(int SIG)
{
printf("\nSIGINT Caught\nExiting...\n");
close(fd);
exit(1);
}

void SpiComm::exit_p(std::string msg)
{
printf("ERROR!\n%s\n", msg.c_str());
if(fd > 0)
close(fd);
exit(1);
}
24 changes: 24 additions & 0 deletions examples/comm/spi/SPICommTest.cpp
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
/*
Project: OpenCogER
File: SPICommTest.cpp
Author: Dagim Sisay <dagiopia@gmail.com>
Date: September 2017
*/

#include "SpiComm.hpp"

int main(int argc, char **argv)
{
SpiComm spi_comm("/dev/spidev0.0", SpiComm::spi_mode::MODE0, 50000);
if ( !spi_comm.okay )
{
printf("Error Connecting To SPI Device\n");
return 1;
}
std::string data, ret;
data = "Hello, SPI";
ret = spi_comm.send_data(data);
printf("Data Sent Size=%d\nRet=<%s>\n", ret.size(), ret.c_str());

return 0;
}
35 changes: 35 additions & 0 deletions examples/sense/vision/RaspiVisionTest.cpp
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
/*
Project: OpenCogER
File: RaspiVisionTest.cpp
Author: Dagim Sisay
License: AGPL
Date: September 2017
*/
#include <iostream>
#include <cstring>

#include "sense/vision/RaspiCamCapture.hpp"

using namespace std;
using namespace cv;


int main( int argc, char** argv )
{
RaspiCamCapture cc("RaspiCam", 320, 240, 30);
if (!cc.isOk()){cout<<endl<<cc.getState()<<endl;return -1;}

Mat frame;
Mat image;
while(true)
{
frame = cc.getCurrentFrame();
frame.copyTo(image);
imshow( "Tracking API", image );

char c = (char) waitKey( 1 );
if( c == 'q' )
break;
}
return 0;
}
2 changes: 1 addition & 1 deletion examples/sense/vision/VisionTest.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ int main( int argc, char** argv )
BoxTrackerThread bx(&cc,frame,boundingBox,BoxTracker::tracker_type::MEDIAN_FLOW);
while(true)
{
if (bx.update(frame,boundingBox))
if (bx.update(frame,boundingBox))
{
frame.copyTo(image);
rectangle( image, boundingBox, Scalar( 255, 0, 0 ), 2, 1 );
Expand Down
65 changes: 65 additions & 0 deletions include/comm/spi/SpiComm.hpp
Original file line number Diff line number Diff line change
@@ -0,0 +1,65 @@
/*
Project: OpenCogER
File: SpiComm.hpp
Author: Dagim Sisay <dagiopia@gmail.com>
Date: September 2017
*/

#ifndef _SPI_MASTER_HPP_
#define _SPI_MASTER_HPP_


#include <stdlib.h>
#include <stdio.h>
#include <stdint.h>
#include <unistd.h>
#include <signal.h>
#include <string>
#include <string.h>
#include <map>
#include <fcntl.h>
#include <sys/ioctl.h>
#include <linux/types.h>
#include <linux/spi/spidev.h>

#define PACKET_SIZE_L_IDX 2
#define PACKET_SIZE_H_IDX 3
#define DEBUG 1

class SpiComm
{
public:
/*
Mode 0: CPHA=0 CPOL=0 ; idle state 0, sample on low-high
Mode 1: CPHA=1 CPOL=0 ; idle state 0, sample on high-low
Mode 2: CPHA=0 CPOL=1 ; idle state 1, sample on high-low
Mode 3: CPHA=1 CPOL=1 ; idle state 1, sample on low-high
*/
enum spi_mode{MODE0, MODE1, MODE2, MODE3};
SpiComm(std::string device, spi_mode sm, uint16_t freq);
~SpiComm();
bool okay;
std::string send_data(std::string data);

/* #TODO Inlcude some GPIO code here that will behave like an interrupt
for reading on the spi comm. The dr_roboto will issue a
SLAVE_DATA_READY signal on one of the gpio pins that should
trigger a read on the SPI.
*/

private:
int fd;
std::string dev; //spi device
uint8_t mode; //spi mode
uint8_t bpw; //bits per word
uint16_t speed;//sclk speed

void exit_p(std::string msg);
void load_map();
void setup();
void sigint_handler(int SIG);

};


#endif // _SPI_MASTER_HPP_
46 changes: 46 additions & 0 deletions include/sense/vision/RaspiCamCapture.hpp
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
/*
Project: OpenCogER
File: RaspiCamCapture.hpp
Author: Dagim Sisay
License: AGPL
Date: September 2017
*/
#ifndef RASPICAMCAPTURE_H
#define RASPICAMCAPTURE_H


#include "sense/vision/ImageSource.hpp"

#include <raspicam/raspicam_cv.h>

#include <iostream>
#include <string>
#include <cstdio>
#include <thread>
#include <mutex>

using namespace std;
using namespace cv;

class RaspiCamCapture: public ImageSource
{
public:
RaspiCamCapture(string src_name, int width=320, int height=240, double max_fps=30.0);

virtual ~RaspiCamCapture();
bool isOn();
bool isOk();
string getState();
Mat getCurrentFrame();//Mat is like shared_ptr, make deep copy here and use mutex
protected:
private:
int w,h;
Mat current;
raspicam::RaspiCam_Cv capture;
static void thread_loop(RaspiCamCapture* cc);
thread* run;
mutex rd;
int wait_time;
};

#endif // RASPICAMCAPTURE_H
Loading