Systematic Architecture [EN]

Sunday, 15 May 2016

Buffalo LinkStation as a Server (BaaS)

Buffalo LinkStation as a Server (BaaS)
======================================
You can use Baffalo LinkStation as a Linux server because it is based on Linux.

Download `acp_commander.jar`
-----------------------------
http://downloads.buffalo.nas-central.org/TOOLS/ALL_LS_KB_ARM9/ACP_COMMANDER/

Run the following commands
---------------------------

```bash
IP=<IP address of your LinkStation>
ADMIN_PW=<the password of admin>
ROOT_PW=<a password of root, which will be set in this process>

java -jar acp_commander.jar -t $IP -ip $IP -pw $ADMIN_PW -c "(echo $ROOT_PW ; echo $ROOT_PW) | passwd"
java -jar acp_commander.jar -t $IP -ip $IP -pw $ADMIN_PW -c "sed -i 's/UsePAM yes/UsePAM no/g' /etc/sshd_config"
java -jar acp_commander.jar -t $IP -ip $IP -pw $ADMIN_PW -c "sed -i 's/PermitRootLogin no/PermitRootLogin yes/g' /etc/sshd_config"
java -jar acp_commander.jar -t $IP -ip $IP -pw $ADMIN_PW -c "/etc/init.d/sshd.sh restart"
```

If you get the following error,
```bash
Trying to authenticate EnOneCmd... ACP_STATE_OK
Trying to authenticate with admin password... ACP_STATE_OK
>sed -i 's/UsePAM yes/UsePAM no/g' /etc/sshd_config
OK (ACP_STATE_OK)
Changeing IP: ACP_STATE_PASSWORD_ERROR
Please note, that the current support for the change of the IP is currently very rudimentary.
The IP has been set to the given, fixed IP, however DNS and gateway have not been set. Use the WebGUI to make appropriate settings.
```
check the variables set without any quotes.

It should be successful as follows
```bash
Trying to authenticate EnOneCmd... ACP_STATE_OK
Trying to authenticate with admin password... ACP_STATE_OK
OK (ACP_STATE_OK)
Changeing IP: ACP_STATE_PASSWORD_ERROR
Please note, that the current support for the change of the IP is currently very rudimentary.
The IP has been set to the given, fixed IP, however DNS and gateway have not been set. Use the WebGUI to make appropriate settings.
```

BTW changeing is a typo and sort of weird English...

If you have the error still, run the following
```bash
$ java -jar acp_commander.jar -t $IP -ip $IP -pw $ADMIN_PW -s
```
and run a command. This is one liner so that you ought to run the above again per a command.

Go with ssh
-----------
```bash
$ ssh -l root <IP address of LinkStation>
```

Shared folders are under `/mnt/array1`.

Misc
----

`acp_commander.jar` can run commands for LinkStation.
You can list commands with `-h`
```bash
java -jar acp_commander.jar -h
```

a result
```
$ java -jar acp_commander.jar -h
there seems to be no existing prefs, write default values
ACP_commander out of the nas-central.org (linkstationwiki.net) project.
Used to send ACP-commands to Buffalo linkstation(R) LS-PRO.

WARNING: This is experimental software that might brick your linkstation!

Version 0.4.1 (beta)

Usage:  acp_commander [options] -t target

options are:
   -t target .. IP or network name of the Linkstation
   -m MAC   ... define targets mac address set in the ACP package *),
                default = FF:FF:FF:FF:FF:FF.
   -na      ... no authorisation, skip the ACP_AUTH packet. You should
                only use this option together with -i.
   -ba      ... use bug/bufferoverflow on LS to bypass usual password
                authentication. Standard until acp_commander 0.4.   -pw passwd . your LS admin password. If not given, but required
                you'll be asked for it.
   -i ID    ... define a connection identifier, if not given, a random one will
                be used. (With param MAC the senders MAC address will be used.)
                Successfull authenitfications are stored in conjunction with a 
                given connection ID. So you may reuse a previously used one.
                Using a lot of different id's in a chain of commands might
                cause a lot of overhead at the linkstation.
   -p port  ... define alternative target port, default = 22936
   -b localIP.. bind socket to local address. Use if acp_commander
                can not find your linkstation (might use wrong adapter).

-f       ... find linkstation(s) by sending an ACP_DISCOVER package
   -o       ... open the linkstation by sending 'telnetd' and 'passwd -d root',
                thus enabling telnet and clearing the root password
   -c cmd   ... sends the given shell command cmd to the linkstation.
   -s       ... interactive shell
   -cb      ... clear \boot, get rid of ACP_STATE_ERROR after firmware update
                output of df follows for control
   -ip newIP... change IP to newIP (basic support).
   -save    ... save configuration
   -load    ... load configuration
   -blink   ... blink LED's and play some tones

-savepref... write out acp_commander.preferences (XML) for editing.
   -loadpref... load acp_commander.preferences (XML) and store values
                in default place.
   -gui nr  ... set Web GUI language 0=Jap, 1=Eng, 2=Ger.
   -addons  ... install addons.tar from local or linkstationwiki.
   -diag    ... run some diagnostics on LS settings (lang, backup).
   -emmode  ... Linkstation reboots next into EM-mode.
   -normmode .. Linkstation reboots next into normal mode.
   -reboot  ... reboot Linkstation.
   -shutdown .. shut Linkstation down.

-d1...-d3 .. set debug level, generate additional output
                debug level >= 3: HEX/ASCII dump of incoming packets
   -q       ... quiet, surpress header, does not work with -h or -v
   -h | -v  ... extended help (this output)
   -u       ... (shorter) usage

*)  this is not the MAC address the packet is sent to, but the address within
    the ACP packet. The linkstation will only react to ACP packets if they
    carry the correct (its) MAC-address or FF:FF:FF:FF:FF:FF

This program is the result of the work done at nas-central.org (linkstationwiki.net),
which is not related with Buffalo(R) in any way.

Experimental software, use with care, it might brick your Linkstation!

If this helps you, please consider donating to www.linkstationwiki.net

$
```

Saturday, 26 December 2015

How to amend your Git history

How to amend/rewrite Git history/commits
================================

# For specific changes

## Change `oldtext` to `newtext` in all changes in commits:

```bash
git filter-branch --tree-filter "find . -exec sed -i -e \
    's/oldtext/newtext/g' {} \;"
```

## You may need `-f` for the second rewriting
```bash
git filter-branch -f --tree-filter "find . -exec sed -i -e \
    's/oldtext2/newtext2/g' {} \;"
```

# For a specific file
## The following example is to remove all the files matching `*-e` in commits.

```bash
git filter-branch --force --index-filter \
'git rm --cached --ignore-unmatch *-e' \
--prune-empty --tag-name-filter cat -- --all
```

# For author info
https://help.github.com/articles/changing-author-info/

```bash
#!/bin/sh

git filter-branch --env-filter '

OLD_EMAIL="your-old-email@example.com"
CORRECT_NAME="Your Correct Name"
CORRECT_EMAIL="your-correct-email@example.com"

if [ "$GIT_COMMITTER_EMAIL" = "$OLD_EMAIL" ]
then
    export GIT_COMMITTER_NAME="$CORRECT_NAME"
    export GIT_COMMITTER_EMAIL="$CORRECT_EMAIL"
fi
if [ "$GIT_AUTHOR_EMAIL" = "$OLD_EMAIL" ]
then
    export GIT_AUTHOR_NAME="$CORRECT_NAME"
    export GIT_AUTHOR_EMAIL="$CORRECT_EMAIL"
fi
' --tag-name-filter cat -- --branches --tags
```

References
==========
https://git-scm.com/book/en/v2/Git-Tools-Rewriting-History

Friday, 25 December 2015

Scala JIRA

Scala JIRA
============

JIRA, an issue tracker can do a bunch of data import/export and operations
- via CSV
- via REST

However neither of them responses 1000 items per request.
So REST is better for a lot of data or complex operations.

Atlassian provide Java library for JIRA REST, 
[JIRA REST Java Client (JRJC)](https://ecosystem.atlassian.net/wiki/display/JRJC/Home)

When you program for JIRA REST, you would use it but I don't feel like using Java in this programming era.

Thus I created a scaffold for JIRA REST with Scala.

Why I create it and show here is there is no specific documentation for the latest JRJC somehow.
- classes and their structures are changed.
- its sbt configuration (Maven dependencies) not written anywhere.

Let's show my scaffold.

Here is dependencies in build.sbt.
```scala

libraryDependencies += "com.atlassian.jira" % "jira-rest-java-client-api" % "3.0.0"
libraryDependencies += "com.atlassian.jira" % "jira-rest-java-client-core" % "3.0.0"

resolvers += "spring-milestones" at "http://repo.spring.io/libs-milestone/"

```

Here is my sample app, which needs more dependencies than the above.
```scala

import java.net.URI

import com.atlassian.jira.rest.client.internal.async.AsynchronousJiraRestClientFactory
import org.joda.time.DateTime
import org.joda.time.format._

import scala.collection.JavaConverters._

/**
  * Created on 2015/12/02.
  */
object Auth {

def main(args: Array[String]) {
    val restClientFactory = new AsynchronousJiraRestClientFactory()
    // http://host:port/context/rest/api-name/api-version/resource-name

import com.typesafe.config.ConfigFactory
    val conf = ConfigFactory.load("account.conf")

//val JIRA_BASE_URL = "http://[team name].atlassian.net/plugins/servlet/oauth/request-token"
    val jiraBaseURL = conf.getString("baseurl")

// JIRA_BASE_URL + "/plugins/servlet/oauth/request-token"
    val uri = new URI(jiraBaseURL)

val username = conf.getString("username")
    val password = conf.getString("password")
    val client = restClientFactory.createWithBasicHttpAuthentication(uri, username, password)

// Invoke the JRJC Client
    val promise = client.getUserClient().getUser(username)
    val user = promise.claim()

client.getProjectClient().getAllProjects().claim().iterator().asScala.map(project => {
      println(project.getKey() + ": " + project.getName())
    })

val dateTime = DateTime.now()
    val dateString = DateTimeFormat.forPattern("yyyy-MM-dd").print(dateTime)
    println("dateString=" + dateString)
    // up to 1000 items even if you specify more.
    val maxResults = 10
    val searchJqlPromise = client.getSearchClient().searchJql(s"due=$dateString ORDER BY assignee", maxResults, null, null)

searchJqlPromise.claim().getIssues.asScala.map(issue => {
      println(issue.getKey + ": " + issue.getSummary)
    })

// Print the result
    println(String.format("Your admin user's email address is: %s\r\n", user.getEmailAddress()));

// Done
    println("Example complete. Now exiting.");
    System.exit(0);

}

```

The whole source codes are [HERE](https://github.com/lamusique/ScalaJIRA).

Grab an Object in 3D with Processing

Grab an Object in 3D with Processing
================================

I want to grab a 3D object.
I came up just with it but that's not twopence work.
I'm an amateur for 3D processing.

The solutions I researched
1. pixels matching
    - Pixelate all objects and match them with the cursor as a computer scientific method.
1. ray casting
    - Cast the ray to the rear which objects may hit as a linear algebraic method.

1 does the trick rather than conceptual calculation so I try 2 first.
The Processing however doesn't have a method from the screen coordination to the model coordination, although it's just a problem if I create or not.

And I tried to reify 2 with the Camera angle from the the front to the rear but it doesn't work yet with unknown distortion of the coordination.

Thus I had to post the article in time I used the existing method, screenX() etc. which can convert the model coordination to the screen coordination.

![demo](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjG3uPHd3e5pOXwEZsg-CACtJ4bvu0QPMIuYtjUzzAQWErn16Q0riCkfW_wNd0x7Pp-dsPX1cW_oI0B9BBIsh0SCGrPlkiaQ12P40-Y7zKwKcAymGouBLLi3YAeyzAiQ-lbkOsTRYnx0H0/s320/grabbing-demo-trimmed.gif)

I didn't have enough time to show it on P5.js.

Here are [source codes](https://github.com/lamusique/ScalaProcessing/blob/feature/samples/src/test/scala/com/nekopiano/scala/processing/sandbox/sample/Grabbing.scala) 
 I wrote with [Processing with Scala](http://sys-architecture.blogspot.com/2015/12/processing-with-scala.html)

ToDos
- Process with inverse matrix based on mathematics.
- Sync the amount of the movement between the mouse and the model
- Move only one object in the front

Monday, 14 December 2015

Processing with Scala

Processing with Scala
======================

The Processing program language is based on Java.
Now while we are in the functional mathematical programming era, it's troublesome to write with Java, which has legacy computer grammar and syntax,
e.g. you ought to write imperative `;` at the end of the line.

Therefore I reify Processing with Scala, which runs on the JVM.
It is similar strategy of P5.js, which runs as pure JavaScript.

I created a kind of the framework for Processing with Scala.
> https://github.com/lamusique/ScalaProcessing

It became easier to import Processing jars since Processing libraries are in the Maven Repository and I imported them on sbt.

Well let's get started and here is an example.
I take an example from the official Processing Examples
https://processing.org/examples/bouncybubbles.html
and port it to Scala.

```scala
package com.nekopiano.scala.processing.sandbox.sample

import com.nekopiano.scala.processing.ScalaPApplet
import processing.core.PApplet

class BouncyBubbles extends ScalaPApplet {
  import BouncyBubbles._

val balls:Set[Ball] = {
    // in parallel
    val localBalls = (0 to numBalls).par.map(i => {
      new Ball(random(width), random(height), random(30, 70), i)
    }).seq.toSet
    localBalls.foreach(_.others = localBalls)
    localBalls
  }

override def settings(): Unit = {
    size(640, 360)
  }

override def setup() {
    noStroke()
    fill(255, 204)
  }

override def draw() {
    background(0)
    balls.foreach(ball => {
      ball.collide()
      ball.move()
      ball.display()
    })
  }

}

object BouncyBubbles {
  // Constants
  val numBalls = 12

val spring = 0.05f
  val gravity = 0.03f
  val friction = -0.9f

// ==== booting process
  val BOOTING_CLASS_NAME = this.getClass.getName.dropRight(1)
  def main(args: Array[String]) {
    // This specifies the class to be instantiated.
    val appletArgs = Array(BOOTING_CLASS_NAME)
    if (args != null) {
      PApplet.main(PApplet.concat(appletArgs, args))
    } else {
      PApplet.main(appletArgs)
    }
  }
}

class Ball(var x:Float, var y:Float, val diameter:Float, val id:Int)(implicit val sp5: ScalaPApplet) {

import sp5._
  import com.nekopiano.scala.processing.Angles._
  import BouncyBubbles._

var others: Set[Ball] = Set.empty[Ball]

var vx = 0f
  var vy = 0f

def collide() {
    others.foreach(ball => {
      val dx = ball.x - x
      val dy = ball.y - y
      val distance = sqrt(dx*dx + dy*dy)
      val minDist = ball.diameter/2 + this.diameter/2
      if (distance < minDist) {
        val angle = atan2(dy, dx)
        val targetX = x + cos(angle) * minDist
        val targetY = y + sin(angle) * minDist
        val ax = (targetX - ball.x) * spring
        val ay = (targetY - ball.y) * spring
        vx -= ax
        vy -= ay
        ball.vx += ax
        ball.vy += ay
      }

})
  }

def move() {
    vy += gravity
    x += vx
    y += vy
    if (x + diameter/2 > width) {
      x = width - diameter/2
      vx *= friction
    }
    else if (x - diameter/2 < 0) {
      x = diameter/2
      vx *= friction
    }
    if (y + diameter/2 > height) {
      y = height - diameter/2
      vy *= friction
    }
    else if (y - diameter/2 < 0) {
      y = diameter/2
      vy *= friction
    }
  }

def display() {
    ellipse(x, y, diameter, diameter)
  }
}

```
Hmm, it doesn't make so much difference yet... I may have taken not good example.

The framework of Processing with Scala hasn't yet ported from all the classes of the original Processing, e.g. all the methods of `PApplet`, so it's work in progress.
The concurrent processes with Scala make errors because drawing processes (line(), box(), etc.) are done by GPU. Scala has to stop the concurrency before GPU drawing.

I hope I will create an editor of Processing for Scala, which makes easily you write codes and test them.
The Scala editor, SPD we know but the project has been suspended for 6 years...
https://github.com/n8han/spde-examples

If you are Scalaist, you should play Processing with Scala.
You can use https://github.com/lamusique/ScalaProcessing as a template and you will understand Processing deeper.